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Abstract — The problem of multicasting multiple messages with 
the help of a relay, which may also have an independent 
message of its own to multicast, is considered. As a first step 
to address this general model, referred to as the compound 
multiple access channel with a relay (cMACr), the capacity 
region of the multiple access channel with a "cognitive" relay 
is characterized, including the cases of partial and rate-limited 
cognition. Achievable rate regions for the cMACr model are then 
presented based on decode-and-forward (DF) and compress-and- 
forward (CF) relaying strategies. Moreover, an outer bound is 
derived for the special case in which each transmitter has a direct 
link to one of the receivers while the connection to the other 
receiver is enabled only through the relay terminal. Numerical 
results for the Gaussian channel are also provided. 

I. Introduction 

Consider two non-cooperating satellites each multicasting 
radio/TV signals to users on Earth. The coverage area and 
the quality of the transmission is limited by the strength of 
the direct links from the satellites to the users. To extend 
coverage, to increase capacity or to improve robustness, a 
standard solution is that of introducing relay terminals, which 
may be other satellite stations or stronger ground stations. The 
role of the relay terminals is especially critical for users that 
lack a direct link from any of the satellites. 

Cooperative transmission has been extensively studied both 
for a single user with a dedicated relay terminal [1], [2] and for 
two cooperating users [3]. In this work, we study cooperation 
in a model with two source terminals simultaneously multicas- 
ting independent information to two receivers with the help of 
a relay. While the source terminals cannot directly cooperate, 
the relay can support both transmissions simultaneously to 
enlarge the multicast capacity region. Moreover, it is assumed 
that the relay station has also its own message to be multicast. 

The model under study is a compound multiple access chan- 
nel with a relay (cMACr) and can be seen as an extension of 
several channel models, for example, the compound multiple 
access channel (MAC), the broadcast channel and the relay 
channel. The main goal of this work is to provide achievable 
rate regions and an outer bound on the capacity region for this 
model. We start our analysis by studying a simplified version 
of the cMACr that consists of a MAC with a "cognitive" 
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Fig. 1. A compound MAC with a relay (cMACr). 



relay. In this scenario the cognitive relay is assumed to know 
both messages non-causally. We provide the capacity region 
for this model. As an intermediate step between the cognitive 
relay model and cMACr, we also consider the relay with finite 
capacity unidirectional links from the transmitters and find its 
capacity region. In this scenario, parts of the messages are 
transmitted to the relay over the finite capacity links and the 
rates of these links determine how much the relay can help 
each user. This is not the case in the general cMACr model 
since decoding at the relay might be restrictive, yet we can 
use these techniques to obtain achievable rate regions. 

We provide achievable rate regions for cMACr with decode- 
and-forward (DF) and compress-and-forward (CF) relaying. In 
the CF scheme, the relay, instead of decoding the messages, 
quantizes and broadcasts its received signal. This corresponds 
to the joint source-channel coding problem of broadcasting a 
common source to two receivers, each with its own correlated 
side information, in a lossy fashion, studied in [8]. This result 
indicates that the pure channel coding rate regions for certain 
multi-user networks can be improved by exploiting related 
joint source-channel coding techniques. The cMACr model is 
also studied in [5], where DF and amplify-and-forward (AF) 
based protocols are analyzed, assuming that no private relay 
message is available. 

The rest of the paper is organized as follows. The system 
model is introduced in Section In Section |III] we study 
several cognitive relay models. The compound multiple access 
channel with a relay is studied in Section |IVl In Section |V] 
numerical results for the Gaussian channel setup are presented. 
Section IVll concludes the paper. 

II. System Model 

A compound multiple access channel with relay consists of 
three input alphabets Xi, X2 and A3 of transmitter 1, transmit- 



ter 2 and the relay, respectively, and three output alphabets 
3^2 and 3^3 of receiver 1, receiver 2 and the relay, respectively. 
We consider a discrete memoryless time-invariant channel 
without feedback characterized by p{yi,y2, yslaJi, a;2, xa) (see 
Fig. [U. Transmitter i has message Wi € Wi, i = 1,2, while 
the relay terminal also has a message W3 G Ws of its own, 
all of which need to be transmitted reliably to both receivers. 

Definition 2.1: A (2"^^ , 2"^^ 2"^% ?i) code for the 
cMACr consists of three sets Wi = {1,...,2"^'} for i = 
1,2,3, two encoding functions /j at the transmitters, i — 1,2, 
fi : Wi Xl^, a set of (causal) encoding functions at 
the relay, j — \,...,n, gj : W3 x 3^|^^ — > A3, and two 
decoding functions hi at the receivers, i — 1,2, hi : yf — + 
Wi X W2 X W3. 

We assume that the relay terminal is capable of full-duplex 
operation, i.e., it can receive and transmit at the same time 
instant. The average error probability is defined as 
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where we defined W = (VKi, W^2, W^s) and W(i) = 
{Wi{i),W2{i),W^{i)). 

Definition 2.2: A rate triplet i?2, i?3) is said to be 
achievable for the cMACr if there exists a sequence of 
(2"fli^ 2"-^^ 2"-"3 n) codes with FJ' -> as n ^ 00. 

Definition 2.3: The capacity region C for the cMACr is the 
closure of the set of all achievable rate triplets. 

III. MAC WITH A Cognitive Relay 

As stated in Section |I] before addressing the general cMACr 
model we first study the MAC with a cognitive relay scenario 
in which the messages Wi and W2 are assumed to be non- 
causally available at the relay terminal (in a "cognitive" 
fashion [6]) and there is only one receiver (3^2 = 3^3 = and 
y = yi). The next proposition provides the capacity region 
for this model. 

Proposition 3.1: For the MAC with a cognitive relay, the 
capacity region is the closure of the set of all non-negative 

(i?i, i?2, -R3) satisfying 

R3<HX3;Y\X,,X2,Ui,U2,Q), (la) 

Ri+R3<I{Xi,X3;Y\X2,U2,Q), (lb) 

R2 + R3 < I{X2,X3;Y\Xi,Ui,Q), and (Ic) 

Ri+R2 + R3<I{Xi,X2,X3;Y\Q) (Id) 

for some joint distribution of the form 

p{q)p{xi,ui\q)p{x2,U2\q)p{x3\ui,U2, q)p{y\xi, X2, X3) (2) 

for some auxiliary random variables Ui, U2 and Q. 

Proof: The capacity region of a MAC with three users 
and any combination of "common messages" (i.e., messages 
known "cognitively" to more than one user) is given in [7]. 

■ 

We next consider the cases of partial and limited-rate 
cognition. 



Proposition 3.2: The capacity region of the MAC with a 
partially cognitive relay (informed only of Wi ) is the closure 
of the set of all non-negative (i?i, i?2, i?3) satisfying 

R2<IiX2;Y\Xi,X3,Q), (3a) 

i?3 </(^3;i"|^i,^2,Q), (3b) 

Ri+R3<I{Xi,X3;Y\X2,Q), (3c) 

R2 + R3<I{X2,X3;Y\Xi,Q), and (3d) 

Ri+R2 + R3<I{Xi,X2,X3;Y\Q). (3e) 

for an input distribution of the form p{q)p{x2\q)p{xi, X3\q). 

Proof: The proof, which we present in [9], is skipped 
here due to lack of space. ■ 

Remark 3.1: The capacity region in Proposition 13.21 fol- 
lows, like Proposition 13.11 from the capacity result by [7] for 
MAC with certain correlated sources. However, the formula- 
tion given in ^ is more convenient than the one obtained from 
[7] since, in the case of partial cognition, the capacity region 
characterization does not require auxiliary random variables 
in addition to the time-sharing random variable Q. This is 
because, unlike the scenario covered by Proposition 13.11 in 
which the relay's codeword can depend on both Wi and W2, 
and the auxiliary random variables quantify the amount of 
dependence on each message, for Proposition 13.21 the relay 
cooperates with only one source, and no auxiliary random 
variable is needed. 

The MAC with a cognitive relay model can be further 
generalized to a scenario with limited-capacity cognition, in 
which the sources are connected to the relay via finite-capacity 
orthogonal links, rather than having a priori knowledge of the 
terminals' messages. In particular, assume that terminal i can 
communicate with the relay, prior to transmission, via a link of 
capacity d for i = 1, 2. The following proposition establishes 
the capacity region of this model. 

Proposition 3.3: The capacity region of the MAC with a 
cognitive relay connected to the source terminals via (unidi- 
rectional) links of capacities Ci and C2 is given by 

Ri<I{X,;Y\X2,X3,Ui,U2,Q) + Ci, 
R2<I{X2;Y\X,,X3,Ui,U2,Q) + C2, 
R3 < I{X3;Y\X,,X2,Ui,U2,Q), 
i?i + i?2 < I{XuX2;Y\X3, C/i, U2, Q) + Ci + C2, 
i?, + i?3<min/ HXuX3;Y\X2,U,,U2,Q) + C,, 



R2 + R3 < min 



I{Xi,X3;Y\X2,U2,Q) 

I{X2,X3;Y\Xi,Ui,U2,Q) + C2 
I{X2,X3:Y\Xi,Ui,Q) 

R1+R2 + R3 < mm{I(Xi, X2, X3;Y\Ui,Q) + Ci, 

I{Xi,X2,X3;Y\U2,Q) + C2,I{X^,X2,X3;Y\Q), 

I{Xi,X2,X3;Y\Ui,U2,Q) + Cx+C2} 

for auxiliary random variables Ui,U2 and Q with joint distri- 
bution of the form 

Proof: The proof, which we present in [9], is skipped 
here due to lack of space. ■ 



Remark 3.2: Based on the results of this section, we 
can now take a further step towards the analysis of the 
cMACr of Fig. [T] by considering the compound MAC with 
a cognitive relay. This channel is shown in Fig. [T] with 
the only difference that the relay here is informed "for 
free" of the messages Wi and W2 and that the signal 
received at the relay is non-informative, e.g., 3^2 = 0- 
The capacity of such a channel follows easily from 
Proposition 13.11 by taking the union over the distribution 
p{Q)pixi,Ui\q)p{x2, U2\q)p{x3\ui,U2, q)p{yi,y2\xi, X2, X3) 
of the intersection of the two rate regions ([T]) evaluated for 
the two outputs Yi and Y2. Notice that this capacity region 
depends on the channel inputs only through the marginal 
distributions p{yi\xi, X2, x^) and p{y2\xi, X2, X3). 

IV. Inner and Outer bounds on the Capacity 
Region of the Compound MAC with a Relay 

In this section, we focus on the general cMACr model illus- 
trated in Fig. [1] Single-letter characterization of the capacity 
region for this model is open even for various special cases. 
Our goal here is to provide inner and outer bounds. 

The following inner bound is obtained by the DF scheme. 
The relay fully decodes messages of both users so that we 
have a MAC from the transmitters to the relay terminal. Once 
the relay has decoded the messages, the transmission to the 
receivers takes place similarly to the MAC with a cognitive 
relay model of Section Hill 

Proposition 4.1: For the cMACr as seen in Fig. [T] any rate 
triplet i?2, R3) with Rj > 0, j = 1, 2, 3, satisfying 

Ri<I{Xi;Y3\Ui,X2,X3,Q), (5a) 
R2<I{X2;Y3\U2,Xi,X3,Q), (5b) 
Ri+ R2 < I{Xi,X2;Y3\Ui,U2,X3,Q), (5c) 
i?3 < min{/(X3;ri|Xi,X2,C/i,C/2,Q), 

I{X3;Y2\Xi,X2,Ui,U2,Q)}, (5d) 
Ri+R3<mm{I{Xi,X3;Yi\X2,U2,Q), 

I{Xi,X3:Y2\X2,U2,Q)}, (5e) 
R2 + R3 <mm{I{X2,X3;Yi\Xi,Ui,Q), 

I{X2..X3;Y2\Xi,Ui,Q)} and (5f) 
Ri + R2 + R3<nim{I{Xi,X2,X3;Yi\Q), 

I{Xi,X2,X3;Y2\Q)} (5g) 

for auxiliary random variables Ui, U2 and Q with a joint dis- 
tribution of the fonnp{q)p{xi,ui\q)p{x2,U2\q)p{x3\ui, U2, q) 
p{yi,y2,y3\xi,X2,X3) is achievable by DF. 

Proof: The proof follows by combining the block- 
Markov transmission strategy with DF at the relay studied 
in [2], the joint encoding to handle the private relay message 
and backward decoding at the receivers. Notice that conditions 
(I5a]i-(l5cb ensure correct decoding at the relay, whereas ( l5db - 
follow similarly to Proposition 13.11 and Remark 13.21 



<5g 



ensuring correct decoding at both receivers. ■ 
Next, we consider applying the CF strategy at the relay 
terminal. In CF relaying introduced in [1], the relay does 



not decode the source message, but facilitates decoding at the 
destination by transmitting a quantized version of its received 
signal. In quantizing its received signal, the relay takes into 
consideration the correlated received signal at the destination 
terminal and applies Wyner-Ziv source compression (see [1] 
for details). In the cMACr scenario, unlike the single-user relay 
channel, we have two distinct destinations, each with different 
side information correlated with the relay received signal. 
This situation is similar to the problem of lossy broadcasting 
of a common source to two receivers with different side 
information sequences considered in [8] (and solved in some 
special cases), and applied to the two-way relay channel setup 
in [4]. Here, for simplicity, we consider broadcasting only a 
single quantized version of the relay received signal to both 
receivers. The following proposition states the corresponding 
achievable rate region. 

Proposition 4.2: For the cMACr of Fig. [T] any rate triplet 
(i?i, i?2, i?3) with Rj > 0, j = 1, 2, 3, satisfying 

i?i < min{/(Xi; n, falXs, X3, Q)J{X,;Y2, ^31^2, ^3, Q)}, 
R2<mm{I{X2;Y2,Y3\Xi,X3,Q),I{X2;Yi,Y3\Xi,X3,Q)}, 

Ri+R2< min{/(Xi , ; ^ , 1^3 1^3 , Q) , 

I{X,,X2;Y2,Y3\X3,Q)} 

such that 

R3 + I{Y3;Y3\X3,Yi,Q) < I{X3;Yi\Q) and 
R3 + I{Y3;Y3\X3,Y2,Q) < I{X3;Y2\Q) 

for random variables Y3 and Q with a joint distribution 

p{q,xi,X2,X3,yi,y2,y3,y3) = P{q)p{xi\q)p{x2\q)p{x3\q) 
p{y3\y3,X3,q)p{yi,y2,y3\xi,X2,X3) is achievable with ^3 
having bounded cardinality. 

Proof: The proof, which we present in [9], is skipped 
here due to lack of space. ■ 

Remark 4.1: The achievable rate region given in Proposi- 
tion 14.21 can potentially be improved. Instead of broadcasting 
a single quantized version of its received signal, the relay can 
transmit two descriptions so that the receiver with an overall 
better quality in terms of its channel from the relay and the 
side information received from its transmitter, receives a better 
description, and hence higher rates (see [8] and [4]). Another 
possible extension which we will not pursue here is to use the 
partial DF scheme together with CF [1], [4]. 

We are now interested in studying the special case in which 
each source terminal can reach only one of the destination 
terminals directly. Assume, for example, that there is no direct 
connection between source terminal 1 and destination terminal 
2, and similarly between source terminal 2 and destination 
terminal 1. In practice, this setup might model either a larger 
distance between the disconnected terminals, or some physical 
constraint in between the terminals blocking the connection. 
In such a scenario, the relay is essential in providing coverage 
to multicast data to both receivers. We model this scenario by 
the (symbol-by-symbol) Markov chain conditions: 



Yi ~ (Xi, X3) - X2 and Y2 - {X2, X3) - Xi. 



(6) 



The following proposition, whose proof we present in [9], 
provides an outer bound for the capacity region. 

Proposition 4.3: Assuming that the Markov chain condi- 
tions ^ hold for any channel input distribution, a rate triplet 
(i?i, i?2, ^3) with Rj > 0, j = 1, 2, 3, is achievable only if 

Ri<IiX,;Y3\UuX2,Xs,Q), 
R2<I{X2;Y3\U2,Xi,X3,Q), 
R3 <mm{I{Xs:Yi\Xi,X2,Ui,U2,Q), 
I{X3;Y2\X,,X2,Ui,U2,Q)}, 
Ri + R3 < mm{I(Xi,X3;Yi\U2,Q), 

I{X3;Y2\X2,U2,Q)}, 
i?2 + i?3 < min{/(X3; FilXi, C/i, Q), 
I{X2,X3:Y2\Ui,Q)} 
i?i + i?2 + i?3 < min{/ (Xi , X3 ; Fi I Q) , / (X2 , X3 ; ^2 1 Q) } 

for some auxiliary random variables Ui , U2 and Q 
satisfying the joint distribution p{q)p{xi,ui\q)p{x2,U2\q) 

p{x3\ui,U2,q)p{yi,y2,y3\xi,X2,X3). 

By imposing the condition ^ on the DF achievable rate 
region of Proposition 14.11 it can be easily seen that the 
only difference between the outer bound and the achievable 
region with DF ^ is that the latter contains the additional 
constraint dScl l. which generally reduces the rate region. The 
constraint dScI l accounts for the fact that the DF scheme 
prescribes both messages Wi and W2 to be decoded at the 
relay terminal. The following remark provides two examples in 
which the DF scheme achieves the outer bound in Proposition 
14.31 and thus the capacity region. In both cases, the multiple 
access interference at the relay terminal is eliminated from 
the problem setup so that the condition ( IScl i does not limit the 
performance of DF. 

Remark 4.2: In addition to the Markov conditions in (|6]l, 
consider orthogonal channels from the two users to the relay 
terminal, that is, we have Y3 = (i^ai, Yy,2), where Y^k depends 
only on inputs Xk and X^ for k — 1,2; that is, we assume 
Xi - (X2, Xa) - Y32 and X2 - (Xi, X3) - I31 form Markov 
chains for any input distribution. Then, it is easy to see that 
the sum-rate constraint at the relay terminal is redundant and 
hence the outer bound in Proposition 14.31 and the achievable 
rate region with DF in Proposition 14. II match, yielding the full 
capacity region for this scenario. As another example where 
DF is optimal, we consider a relay multicast channel setup, 
in which a single relay helps transmitter 1 to multicast its 
message Wi to both receivers, i.e., R2 = i?3 = and X2 = 0. 
For such a setup, under the assumption that Xi — Xj, — Y2 
forms a Markov chain, the achievable rate with DF relaying in 
Proposition |4T| and the above outer bound match. Specifically, 
the capacity C for this multicast relay channel is given by 

C= max min{/(Xi;F3|^3), /(Xi,X3;Yi), I{X3;Y2)}. 

Remark 4.3: This work is limited to random coding tech- 
niques to provide achievable rate regions. However, the struc- 
ture of the network under the Markov assumptions in (|6]l can 
be exploited using structured codes rather than the random 



codes. This enables the relay to decode only the modulo sum 
of the messages relaxing the sum-rate constraint at the relay. 
We explore this in more detail in [9] and show that structured 
coding schemes achieve the capacity in certain scenarios. 

V. Gaussian Compound MAC with a Relay 

A Gaussian cMACr satisfying the Markov conditions (|6]l is 
given by 



Yi=Xi+ 77X3 + Zi 
¥2^X2 + r/X3 + Z2 

^3 =7(^1 +^2) + ^3, 



(7a) 
(7b) 
(7c) 



where 7 > is the channel gain from the users to the relay and 
?7 > is the channel gain from the relay to both receiver 1 and 
receiver 2. The noise components Zi, i = 1,2,3 are i.i.d. zero- 
mean unit variance Gaussian random variables. We enforce the 
average power constraints i ^ ^ Pj for J = 1:2,3. 

i—l 

We define C{x) = ^ log(l + x) for x G R+. Considering for 
simplicity the case R3 = 0, we have the following result. 

Proposition 5.1: The following rate region is achievable for 
the Gaussian cMACr characterized by ^ with DF: 

^(7^^1(1-1^)) 
C(j^P2(l "'"'^ 



and 



i?i < min • 



(8a) 



i?2<min<; -"V'^^V^ i-"i"3yy' !■ (8b) 
C{P2+v'P3{l~a'3)) 



Ri+R2< min {c (Pi + tj^Ps + 2t^^ aia'^PiP^) , 
C (P2 + 7?'P3 + 2ri^aia'^P2P3) , 



C 7'(A+P2) 1- 



P1+P2 



(8c) 



with the union taken over the parameters < ai,a2,a'^,a'^ < 
1 and Qfg + Qfg < 1 . An outer bound to the capacity region is 
given by ^ without the last sum-rate constraint in dScb . 

Proof: The proof can be found in [9] ■ 

It is noted that the parameters a'.^ and a'^ represent the 
fractions of power that the relay uses to cooperate with 
transmitter 1 and 2, respectively. 

Next, we characterize the achievable rate region for the 
Gaussian setup with the CF strategy of Proposition 14.21 
Here, we assume a Gaussian quantization codebook without 
claiming optimality. 

Proposition 5.2: The following rate region is achievable for 
the Gaussian cMACr characterized by (|7]i: 



Ri<C 



R2<C 



2^02^^ 



and 



(9a) 



(9b) 




Fig. 2. Achievable rate region and outer bound for Pi = P2 = P3 = 5 dB, 
ry^ = 10 and different values of the channel gain from the terminals to the 
relay, namely 7^ = 1,5. 

i?, + i?.<c(p) + c(2:>i^±^) (90 

where 

_ 1 + 7^(aiPi 0:2^2 + aiPi + a2-P2) + P 

for all < ai < 1, i = 1,2, where we defined P — 
mm{aiPi,a2P2}- 

1) Numerical examples: Consider a cMACr with powers 
Pi — P2 = P3 = 5 dB and channel gain ij^ ~ 10 from 
the relay to the two terminals. Fig. |2] shows the achievable 
rate region and the outer bound for different values of the 
channel gain from the terminals to the relay, namely 7^ = 1 
and 7^ = 5. It can be seen that, if the channel to the relay is 
weak, then CF improves upon DF at certain parts of the rate 
region. However, as 7^ increases, DF gets very close to the 
outer bound dominating the CF rate region, since the sum rate 
constraint in DF scheme becomes less restricting. 

In Fig. [3] the symmetric rate achievable with DF and CF is 
compared with the upper bound for 7^ = 1 and 77^ = 10 versus 
Pi = P2 = P3 = P- We see that while DF achieves a higher 
rate than CF and performs very close to the upper bound at 
low power values, with increasing power CF surpasses the DF 
rate for this channel setup. There is a constant bit gap between 
the upper bound and the achievable rates with DF and CF at 
higher power values. 

VI. Conclusions 

We have considered a compound MAC with a relay ter- 
minal. In this model, the relay simultaneously assists both 
transmitters while multicasting its own information at the same 
time. We have first characterized the capacity region for a 
MAC with a cognitive relay and related models of partially 



Fig. 3. Symmetric rate achievable with DF and CF strategies compared with 
the upper bound for 7^ = 1 and rj^ = 10 versus Pi = P2 = P3 = P- 

cognitive relay and cognition through finite capacity links. We 
then have used the coding technique that achieves the capacity 
for these models to provide an achievable rate region with 
DF relaying in the case of a general cMACr We have also 
considered a CF relaying scheme, in which the relay broad- 
casts a compressed version of its received signal considering 
the received signals at the receivers as side information. Here 
we have used a novel joint source-channel coding scheme to 
improve the achievable rate region of the underlying multi- 
user channel coding problem. Strategies based on structured 
codes and physical layer network coding are studied in [9]. 
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